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DETAILED ACTION 

Response to Amendment 

1 . Applicant's request for reconsideration of the finality of the rejection of the last 
Office action is persuasive and, therefore, the finality of that action is withdrawn. 

Response to Arguments 
Applicant's arguments, see page 1, section A. of the pre-appeal brief of 6/2/09 
that "Lee1 in view of Lee2 does not disclose or suggest the limitation in the 
independent claims that 'filter coefficients for an interpolation filter are scaled by 
an inverse of a gradient value.'", filed 4/20/09, with respect to 103(a) have been fully 
considered and are persuasive. The rejections of claims 2-4,6-10,15-20 and 23-42 has 
been withdrawn. However, upon further consideration, a new ground(s) of rejection is 
made in view of Biswas et al. (SMOOTHING OF DIGITAL IMAGES USING THE 
CONCEPT OF DIFFUSION PROCESS). 

Claim Rejections - 35 USC §112 

2. The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

3. Claim 37 is rejected under 35 U.S.C. 112, second paragraph, as being indefinite 
for failing to particularly point out and distinctly claim the subject matter which applicant 
regards as the invention. 

Where applicant acts as his or her own lexicographer to specifically define a term 
of a claim contrary to its ordinary meaning, the written description must clearly redefine 
the claim term and set forth the uncommon definition so as to put one reasonably skilled 
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in the art on notice that the applicant intended to so redefine that claim term. Process 
Control Corp. v. HydReclaim Corp., 190 F.3d 1350, 1357, 52 USPQ2d 1029, 1033 (Fed. 
Cir. 1999). The term "renormalization" in claim 37 is used by the claim to mean 
"replacement of the missing filter coefficients", while the accepted meaning is "to make 
an pixel intensity value independent of an input device and scalable for an output 
device" as discussed in Avinash (US Patent 6,757,442), col. 5, lines 44-60. The 
teaching of Avinash of renormalization without the claimed missing coefficients and the 
claimed renormalization that requires the missing coefficients is a contradiction and 
requires clarification. The term is indefinite because the specification does not clearly 
redefine the term. 

Note that claim 37 was indicated allowable as of the office action of 9/17/08, 
page 12 pending on what renormalization means. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 2-4,6-9,15-17,25-31,33,34 and 36 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Lee et al. (US Patent 6,539,060 B1) in view of Biswas et al. ( 
SMOOTHING OF DIGITAL IMAGES USING THE CONCEPT OF DIFFUSION 
PROCESS). 
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Regarding claim 2, Lee 1 teaches a method of processing all or a portion of a 
multi-dimensional signal with a domain composed of a collection of arbitrarily shaped 
domains via a multi-scale transform comprising the steps of: 

a. Obtaining a multi-dimensional digital image frame (as shown in fig. 5); 

b. Breaking the image frame into constituent arbitrary shaped domains (one 
of which is shown in fig. 6A that represents an edge portion of an arbitrarily shaped 
object), or given such a set, that cover all or a portion of the original multidimensional 
signal domain (since fig. 5 serves as the foundation for all the shapes of fig. 6A); and 
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c. Performing a combined domain and pattern adaptive transform (fig. 
1 :IDCT is used in a transform domain in combination with adaptive characteristics of fig. 
1 , num. 10 that uses patterns which is the same as edges from edge detection) on one 
or more of the collection (fig. 2:8X8 DCT COEFFICIENTS) of arbitrary shaped 
domains (since said coefficients have the "same value[s]" in col. 8, lines 3-18 as the 
pixels of fig. 5), wherein a filter (fig. 1 , num. 1 10 following the transform) comprising a 
convolution operator (since 1 10 is a filter that has convolution operator) is applied (the 
results of which is shown in fig. 6C) to process pixels near a boundary (fig. 6C: BLOCK 
BOUNDARY) of the domain (fig. 5), and wherein filter coefficients (corresponding to 
"weighting factors" in col. 1 1 , lines 55-58 shown in TABLE 1 in columns 11,12 and more 
specifically in row 1 of TABLE 1 shows a weighting factor of "4" from "4A") for an 
interpolation filter (or "low-pass filtering" in col. 11, lines 50-52 that smooth the same as 
interpolation) are scaled (the weighting factors are not clearly scaled) by an inverse (the 
weighting factors are not clearly scaled by an inverse) of a gradient value (the weighting 
factors are not clearly scaled from values from "gradient operators" in col. 10, lines 65- 
67). 

Lee does not clearly teach an inverse of a gradient value, but teaches an edge or 
non-edge via "gradient operators" in col. 10, lines 65-67. 

Biswas teaches weighting function in terms of changing the weighting, W s , via an 
"inverse... gradient" on page 498, section 3, 1 st sentence, a m , as represented in fig. 1 . 
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t would have been obvious to one of ordinary skill in the art at the time the 
invention was made to modify Lee's edge gradient detection with Biswas's teaching of 
"edgy" on page 500, section 4, 1 st sentence, detection with inverse gradient weighted 
smoothing, because Biswas's smoothing is an "important [and necessary] image 
processing oper-ation" on page 497, section 1, lines 1-5. 

Claim 3 is rejected the same as claim 2. Thus, argument similar to that presented 
above for claim 2 is equally applicable to claim 3 except for the additional limitations as 
taught in Lee of: 

c. Quantizing resultant decomposition coefficients; and 

d. Encoding and transmitting quantized values over an information 

channel to a decoder for reconstruction of an approximated signal (via MPEG a part of 
which is shown in fig. 1 that is known to include limitations c. and d.). 

Claim 4 is rejected the same as claim 3. Thus, argument similar to that presented 
above for claim 3 is equally applicable to claim 4. 

Regarding claim 6, Lee teaches the method of claim 2, wherein the interpolation 
filter comprises a set of the filter coefficients (as shown in Table 1, row 1 wherein "4A" 
has a coefficient of "4" and "B" has a coefficient of "1" and both share a common 
coefficient of "1/8" as known to one of ordinary skill in mathematics). 

Regarding claim 7, Biswas teaches the method of claim 6, wherein the gradient 
value is computed for each filter coefficient from a center (as shown in fig. 1 at zero) of 
the set of filter coefficients. 



Application/Control Number: 10/032,394 Page 7 

Art Unit: 2624 

Regarding claim 8, Lee broadly teaches a 4X4 set of filter coefficients as shown 
in fig. 8B. Since 8B shows the processing area that is a 4X4 set of pixels with a 
corresponding set of coefficients that are applied to the 4X4 set of pixels. 

Claim 9 is rejected the same as claim 3, limitations c. and d.. Thus, argument 
similar to that presented above for claim 3c. and 3d. is equally applicable to claim 9. 

Regarding claim 15, Lee discloses the method as in any one of claims 2 or 6 
where the multi-dimensional image frame (fig. 5) is a still image frame (since fig. 5 
represents a frame that has no remaining motion processing). 

Claim 16 is rejected the same as claim 15. Thus, argument similar to that 
presented above for claim 1 5 is equally applicable to claim 16. 

Regarding claim 17, Lee discloses the method as in any one of claims 2 or 6 
where the multi-dimensional image frame is a residue frame ("residual signal" in col. 3, 
line 39) for a sequence of video images. 

Regarding claim 25, Lee discloses the method as in claim 6 where the domain 
adaptive transform (said IDCT) is applied such that (after said IDCT) the points external 
to the arbitrary domain (said pixels A and F) but within support of a filter (or filters) are 
excluded (as shown in fig. 6A relative to fig. 6C) from a mathematical result (as shown 
in fig. 6C) of a convolution(via the application of the filter to pixels) or weighted average 
/difference. 

Regarding claim 26, Lee discloses the method as in any one of claims 1 or 6 
where the domain adaptive transform is applied such that points external (fig. 8B: "Non- 
edge pixel") to the arbitrarily shaped domain (fig. 8B: "Edge pixel") but within support of 
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the filter (fig. 8A) are included in a mathematical result of a convolution or weighted 
average / difference but are further multiplied (or re-weighted) by another set of 
weighting factors (as indicated in TABLE 1 in col. 1 1 to col. 12 that describes various 
weight combinations in the context of edges and the kernel). 

Regarding claim 27, Lee discloses the method of claim 26 where the set of 
additional multiplicative factors (said TABLE 1) is determined as a result of calculation 
of a local measure (via said edge detection) characterizing a transition (as shown in fig. 
8B, top most left Edge pixel and adjacent left Non-edge pixel) at a boundary of the 
arbitrary domain (Edge pixel). 

Regarding claim 28, Lee discloses the method of claim 27 where the measure 
(said edge detection) is based on a statistical function ("Average" in col. 10, line 35) of a 
plurality of pixel value differences ("value[m]-Average" in col. 10, line 35) across the 
boundary transition (where said "value[m]-Average" corresponds to corners as shown in 
fig. 7C of an 8x8 block as shown in fig. 7B and shown again, unlabeled in fig, 8B where 
said top left most Non-edge pixel is part of said transition). 

Claims 29 and 30 are rejected the same as claim 28. Thus, argument similar to 
that presented above for claim 28 is equally applicable to claims 29 and 30. 

Regarding claim 31 , Lee discloses the method of claim 28 where the statistical 
function is based on a weighted average (represented by the SAF column in TABLE 1 
of columns 11 and 12). 

Regarding claim 33, Lee discloses the method of claim 28 where 
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the statistical function is a pre-determined constant (since the Average is divided by a 
constant as shown in col. 10, line 31). 

Claim 34 is rejected the same as claim 27. Thus, argument similar to that 
presented above for claim 27 is equally applicable to claim 34. 

Regarding claim 36, Lee discloses the method of claim 34 where the calculation 
of the local measure is based on a motion compensated model frame (fig. 1: MOTION 
COMPENSATOR) (or equivalent) that has already been decoded and thus made known 
to the decoder by the time of the inverse transform step in the context of a encoder- 
decoder system related to the efficient transmission or storage of a sequence of video 
data (the unaddressed limitations above are well known to one of ordinary skill in the art 
of encoding/decoding frames). 

6. Claim 10 is rejected under 35 U.S.C. 103(a) as being unpatentable over Lee et 
al. (US Patent 6,539,060 B1 ) in view of Biswas et al. ( SMOOTHING OF DIGITAL 
IMAGES USING THE CONCEPT OF DIFFUSION PROCESS) as applied to claim 2, 
above and further in view of Lei et al. (US Patent 6,356,665 B1). 

Regarding claim 10, Lee does not disclose claim 10 and instead uses 
quantization with encoding. 

Lei teaches quantization with encoding that is traditional in col. 3 lines 65,66 and 
offers an alternative called "Bit-Plane Approach" as discussed in col. 3, line 65 to col. 4, 
line 22. 

It would have been obvious at the time the invention was made to one of ordinary 
skill in the art to modify Lee's quantization with encoding that has been identified by Lei 
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as traditional with Lei's bit-plane approach, because Lei's approach provides an 
"advantage" in col. 4, lines 18,19. 

7. Claims 18 and 35 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Lee et al. (US Patent 6,539,060 B1 ) in view of Biswas et al. ( SMOOTHING OF 
DIGITAL IMAGES USING THE CONCEPT OF DIFFUSION PROCESS), above, further 
in view of Ostermann (US Patent 5,646,689). 

Regarding claim 18, Lee suggests that a forward transform exists to complement 
Lee's fig. 1 of IDCT that is applied as the claimed domain adaptive transform 

Ostermann teaches a DCT which is a forward transform and claim 18 of a 
calculation of coarser scale representations (via fig. 2, num. 24 that uses coarse 
quantization as discussed in col. 6, lines 18-22 upon the output of the claimed forward 
transform) in a forward transform of a multi-scale transform (since fig. 2, num. 22 is a 
transform used to change the resolution which is scaling, fig. 2, num. 22 is the claimed 
multi-scale transform). 

It would have been obvious at the time the invention was made to one of ordinary 
skill in the art to modify Lee's implied forward transform with Ostermann's forward 
transform that includes quantization, because Ostermann's quantization is used for 
efficient bandwidth control via fine and coarse quantization during transmission to a 
decoder as discussed in col. 1, lines 26-29. 

Regarding claim 35, Lee implies that an encoder is used with Lee's 
decoder/dequantization. 
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Ostermann teaches an encoder as shown in fig. 2 and claim 35 of one or more 
coarser scales of representation of the signal (via coarse quantization as discussed in 
col. 6, lines 10-23) which have already been decoded (via an implied decoder) and thus 
made known to the decoder by the time of the inverse transform step. 

It would have been obvious at the time the invention was made to one of ordinary 
skill in the art to modify Lee's teaching of an encoder and dequantization with 
Ostermann's encoder for the same reasons as claim 18, above. 
8. Claims 19,20,23 and 24 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Lee et al. (US Patent 6,539,060 B1) in view of Biswas et al. ( 
SMOOTHING OF DIGITAL IMAGES USING THE CONCEPT OF DIFFUSION 
PROCESS), as applied to claim 6 above, further in view of Etoh (US Patent 5,859,932). 

Regarding claim 19, Lee applies the claimed transform or said IDCT with post- 
filtering. 

Etoh applies an IDCT in fig. 2, num. 217 and teaches converting from DCT/IDCT 
to the claimed sub-band decomposition/composition of a multi-scale transform as 
indicated in fig. 3, numerals 307 and 321 and claim 19 of where the domain adaptive 
transform is applied (during conversion from IDCT to composition) during the estimation 
of next finer scale representations (of the composition that corresponds to "more 
visually important components" in col. 12, lines 8-12) in an inverse transform (said 
composition) of a multi-scale transform during the reconstruction phase (or decoding) 
either in conjunction with or irrespective of the use of the method in claim 18. 
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It would have been obvious at the time the invention was made to one of ordinary 
skill in the art to modify Lee's IDCT and post-filtering with Etoh's 
composition/decomposition, because Etoh's composition does not include blocking 
artifacts as DCT/IDCT does as discussed in col. 4, lines 25-41 as saves from post- 
filtering as done in Lee. 

Regarding claim 20, Lee does not teach claim 20 and applies the domain 
adaptive transform or said IDCT. 

Etoh applies an IDCT in fig. 2, num. 217 and teaches converting from DCT/IDCT 
to the claimed sub-band decomposition/composition of a multi-scale transform as 
indicated in fig. 3, numerals 307 and 321 . 

It would have been obvious at the time the invention was made to one of ordinary 
skill in the art to modify Lee's IDCT with Etoh's composition/decomposition, because 
Etoh's composition does not include blocking artifacts as DCT/IDCT does as discussed 
in col. 4, lines 25-41 . 

Claim 23 is rejected the same as claim 19. Thus, argument similar to that 
presented above for claim 19 is equally applicable to claim 23. 

Regarding claim 24, Etoh teaches the methods of claim 19 where the domain 
adaptive transform is applied (during said conversion) with the presence of quantization 
(fig. 1, num. 104). 

9. Claim 32 and 37-42 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Lee et al. (US Patent 6,539,060 B1 ) in view of Biswas et al. ( SMOOTHING OF 
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DIGITAL IMAGES USING THE CONCEPT OF DIFFUSION PROCESS), as applied to 
claim 28 above, further in view of Avinash (US Patent 6,757,442). 

Claim 32 is rejected the same as claim 41 . Thus, argument similar to that 
presented below for claim 41 is equally applicable to claim 32. 

Regarding claim 37, Lee does not disclose claim 37 and instead teaches post- 
filtering as shown in fig. 1 , num. 10 that includes averages corresponding to TABLE 1 in 
columns 1 1 and 12. 

Avinash teaches filtering as shown in fig. 3, num. 55 that includes 
renormalization in fig. 4, num. 74 and claim 37: 

where a function (fig. 4, numerals 62-72) for renormalization (fig. 4, num. 74), i.e. 
replacement of the missing filter coefficients (not that the claimed "i.e." is interpreted as 
an "or" limitation so that the claimed "replacement of the missing filter coefficients" are 
excluded, but are standing), is accomplished by a statistical function (at least one of 
said fig. 4, numerals 68-72 includes a statistical function) of remaining pixel values 
(separated from a thresholding operation of fig. 7 and of fig. 5, numerals 84 and 86 that 
separates pixels corresponding to fig. 2, num. 36) which are located at points contained 
within the arbitrary shaped domain (as shown in fig. 2 as num. 48 or 52). 

It would have been obvious at the time the invention was made to one of ordinary 
skill in the art to modify Lee's post filtering with Avinash's filter, because Avinash's filter 
has a plurality of benefits such as enhancing structural features, sharpening structural 
features and removing or smoothing noise as discussed in col. 2, lines 56-67. 



Application/Control Number: 10/032,394 Page 14 

Art Unit: 2624 

The examiner believes that claim 37 can be allowable in the context of 
applicant's fig. 16G; however, further discussion is required and invites applicant's 
representative to discuss claim 37 and fig. 16G. 

Regarding claim 38, Avinash discloses the method of claim 37 where the 
statistical function is based on the median (fig. 11:202: "WEIGHTED AVERAGE" 
corresponds to the claimed median). 

Claims 39 and 40 are rejected the same as claim 38. Thus, argument similar to 
that presented above for claim 38 is equally applicable to claims 39 and 40. 

Regarding claim 41 , Avinash discloses the method of claim 40 where the 
statistical function is a weighted average (see claim 38, above) with coefficients (via an 
equation p(x,y) in col. 18, line 35) that are nonlinear (as said equation has superscripts) 
functions of the data values themselves. 

Regarding claim 42, Avinash discloses the method of claim 37 where some form 
of outlier rejection (or noise removal) is used (in fig. 4) to ensure that outliers (or noise) 
remaining inside the intersection of the domain and the filter support do not disrupt the 
local accuracy or efficiency (or blending with minimal noise) of the transform (fig. 4, 
num. 76). 

Conclusion 

10. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 
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Som et al. (Properties of Minimum Cross-Entropy Reconstruction of Emission 
Tomography with Anatomically Based Prior) is pertinent as teaching a method of a 
inverse gradient smoothing filter in fig. 1 and equation (2). 

1 1 . Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to DENNIS ROSARIO whose telephone number is 
(571)272-7397. The examiner can normally be reached on 9-5PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Matthew Bella can be reached on (571)272-7778. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/ Dennis Rosario/ 
Examiner, Art Unit 2624 



/Matthew C Bella/ 

Supervisory Patent Examiner, Art 

Unit 2624 
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